منابع مشابه
Perturbed Markov chains
We obtain results on the sensitivity of the invariant measure and other statistical quantities of a Markov chain with respect to perturbations of the transition matrix. We use graph-theoretic techniques, in contrast with the matrix analysis techniques previously used. keywords: Perturbed Markov chains, conductance. Primary subject classification: 60J10 Secondary subject classification: 60F10 ∗M...
متن کاملA Nonhomogeneous Hidden Markov Model for Precipitation
A stochastic model for relating precipitation occurrences at multiple rain gauge stations to broad-scale atmospheric circulation patterns (the so-called \downscaling problem") is proposed. The model is an example of a nonhomogeneous hidden Markov model and generalizes existing downscaling models in the literature. The model assumes that atmospheric circulation can be classi ed into a small numb...
متن کاملDenumerable State Nonhomogeneous Markov Decision Processes
We consider denumerable state nonhomogeneous Markov decision processes and extend results from both denumerable state homogeneous and finite state nonhomogeneous problems. We show that, under weak ergodicity, accumulation points of finite horizon optima (termed algorithmic optima) are average cost optimal. We also establish the existence of solution horizons. Finally, an algorithm is presented ...
متن کاملConvergence properties of perturbed Markov chainsbyGareth
Richard Tweedie for helpful conversations.
متن کاملOccupation laws for some time-nonhomogeneous Markov chains
We consider finite-state time-nonhomogeneous Markov chains whose transition matrix at time n is I + G/nζ where G is a “generator” matrix, that is G(i, j) > 0 for i, j distinct, and G(i, i) = − ∑ k 6=iG(i, k), and ζ > 0 is a strength parameter. In these chains, as time grows, the positions are less and less likely to change, and so form simple models of age-dependent time-reinforcing schemes. Th...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Linear Algebra and its Applications
سال: 1999
ISSN: 0024-3795
DOI: 10.1016/s0024-3795(98)10025-3